Results Of Process Evaluation Research Articles

Process Evaluations of Diabetes Self-Management Programs: A Systematic Review of the Literature.

To conduct a systematic review of process evaluations (PEs) of diabetes self-management programs (DSMPs). An electronic search using Medline (Ovid), Embase (Ovid), CINAHL (Ensco), Academic Search (Ebsco), and APA PsycInfo (Ebsco). Peer-reviewed, empirical quantitative, qualitative, or mixed-method studies were included if they (1) were a traditional, group-based DSMP, (2) involved adults at least 18 years with T1DM or T2DM, (3) were a stand-alone or embedded PE, and (4) published in English. The following process evaluation outcomes were extracted: fidelity, dose delivered, dose received, reach, recruitment, retention, and context. Additional items were extracted, (eg, process evaluation type, data collection methods; theories; frameworks or conceptual models used to guide the process evaluation, and etc). Due to heterogeneity across studies, studies were synthesized qualitatively (narratively). Sixty-eight studies (k) in 78 articles (n) (k = 68; n = 78) were included. Most were mixed methods of low quality. Studies were typically integrated into outcome evaluations vs being stand-alone, lacked theoretical approaches to guide them, and incorporated limited outcomes such as dose received, reach, and retention. Future research should 1) implement stand-alone theoretically grounded PE studies and 2) provide a shared understanding of standardized guidelines to conduct PEs. This will allow public health practitioners and researchers to assess and compare the quality of different programs to be implemented.

A Mobile Health Resistance Training Intervention Using Outdoor Gym Equipment: Process Evaluation of the Ecofit Effectiveness Randomized Controlled Trial.

Few mobile health resistance-based physical activity interventions have targeted community-dwelling adults. "Ecofit" is a multicomponent intervention that promotes resistance and aerobic activities using smartphone technology, outdoor gyms, and social support. This study evaluated process evaluation outcomes of the ecofit randomized controlled trial: (1)the acceptability and usability of the ecofit smartphone app and app user workouts; (2)perceptions of factors influencing outdoor gym use; and (3)the fidelity, reach, recruitment, and dose received of the ecofit program. Process data were collected through program evaluation surveys at 3months, and app usage data were collected via the intervention platform for up to 3months. Data were analyzed using descriptive statistics. The survey was completed by 57% (n = 69) of eligible participants. The majority (93%) believed the app provided them with sufficient information to perform muscle-strengthening activities. Approximately half (51%) agreed that the goal-setting function encouraged them to complete their workouts, and 42% agreed that the self-assessment helped them monitor progress. "Proximity" to outdoor gyms emerged as the most important factor for choosing locations to workout (mean = 5.5, SD = 1.1). Participants logged a median of 5.5 (interquartile range = 19) workouts and 1 (interquartile range = 1) upper- and lower-body muscular fitness self-assessment. The ecofit app provided participants with sufficient skills to perform unsupervised resistance training exercises using mobile health. Only half of the participants regarded self-assessments and goal setting as useful, suggesting a need for modifications to how these are implemented. Mobile health remains a promising delivery platform to promote unsupervised resistance training, although more research is needed to improve uptake.

TOward a comPrehensive supportive Care intervention for Older men with metastatic Prostate cancer (TOPCOP3): A pilot randomized controlled trial and process evaluation

IntroductionCurrent management of metastatic prostate cancer (mPC) includes androgen receptor axis-targeted therapy (ARATs), which is associated with substantial toxicity in older adults. Geriatric assessment and management and remote symptom monitoring have been shown to reduce toxicity and improve quality of life in patients undergoing chemotherapy, but their efficacy in patients being treated with ARATs has not been explored. The purpose of this study is to examine whether these interventions, alone or in combination, can improve treatment tolerability and quality of life (QOL) for older adults with metastatic prostate cancer on ARATs. Materials and MethodsTOPCOP3 is a multi-centre, factorial pilot clinical trial coupled with an embedded process evaluation. The study includes four treatment arms: geriatric assessment and management (GA + M); remote symptom monitoring (RSM); geriatric assessment and management plus remote symptom monitoring; and usual care and will be followed for six months. The aim is to recruit 168 patients between two cancer centres in Toronto, Canada. Eligible participants will be randomized equally via REDCap. Participants in all arms will complete a comprehensive baseline assessment upon enrollment following the Geriatric Core dataset, as well as follow-up assessments at 1.5, 3, 4.5, and 6 months. The co-primary outcomes will be grade 3–5 toxicity and QOL. Toxicities will be graded using the National Cancer Institute Common Terminology Criteria for Adverse Events version 5.0. QOL will be measured by patient self-reporting using the EuroQol 5 dimensions of health questionnaire. Secondary outcomes include fatigue, insomnia, and depression. Finally, four process evaluation outcomes will also be observed, namely feasibility, fidelity, and acceptability, along with implementation barriers and facilitators. DiscussionData will be collected to observe the effects of GA + M and RSM on QOL and toxicities experienced by older adults receiving ARATs for metastatic prostate cancer. Data will also be collected to help the design and conduct of a definitive multicentre phase III randomized controlled trial. This study will extend supportive care interventions for older adults with cancer into new areas and inform the design of larger trials.Trial registration: The trial is registered at clinicaltrials.gov (registration number: NCT05582772).

Exploring critical intervention features and trial processes in the evaluation of sensory integration therapy for autistic children

BackgroundWe evaluated the clinical and cost-effectiveness of manualised sensory integration therapy (SIT) for autistic children with sensory processing difficulties in a two-arm randomised controlled trial. Trial processes and contextual factors which may have affected intervention outcomes were explored within a nested process evaluation. This paper details the process evaluation methods and results. We also discuss implications for evaluation of individual level, tailored interventions in similar populations.MethodsThe process evaluation was conducted in line with Medical Research Council guidance. Recruitment, demographics, retention, adherence, and adverse effects are reported using descriptive statistics. Fidelity of intervention delivery is reported according to the intervention scoring manual. Qualitative interviews with therapists and carers were undertaken to explore the acceptability of the intervention and trial processes. Qualitative interviews with carers explored potential contamination.ResultsRecruitment, reach and retention within the trial met expected thresholds. One hundred thirty-eight children and carers were recruited (92% of those screened and 53.5% of those who expressed an interest) with 77.5% retained at 6 months and 69.9% at 12 months post-randomisation. The intervention was delivered with structural and process fidelity with the majority (78.3%) receiving a ‘sufficient dose’ of intervention. However, there was considerable individual variability in the receipt of sessions. Carers and therapists reported that trial processes were generally acceptable though logistical challenges such as appointment times, travel and COVID restrictions were frequent barriers to receiving the intervention. No adverse effects were reported.ConclusionsThe process evaluation was highly valuable in identifying contextual factors that could impact the effectiveness of this individualised intervention. Rigorous evaluations of interventions for autistic children are important, especially given the limitations such as limited sample sizes and short-term follow-up as faced by previous research. One of the challenges lies in the variability of outcomes considered important by caregivers, as each autistic child faces unique challenges. It is crucial to consider the role of parents or other caregivers in facilitating access to these interventions and how this may impact effectiveness.Trial registrationThis trial is registered as ISRCTN14716440. August 11, 2016.

Improving regional medical laboratory center report quality through a report recall management system.

Currently, most medical laboratories do not have a dedicated software for managing report recalls, and relying on traditional manual methods or laboratory information system (LIS) to record recall data is no longer sufficient to meet the quality management requirements in the large regional laboratory center. The purpose of this article was to describe the research process and preliminary evaluation results of integrating the Medical Laboratory Electronic Record System (electronic record system) laboratory report recall function into the iLab intelligent management system for quality indicators (iLab system), and to introduce the workflow and methods of laboratory report recall management in our laboratory. This study employed cluster analysis to extract commonly used recall reasons from laboratory report recall records in the electronic record system. The identified recall reasons were validated for their applicability through a survey questionnaire and then incorporated into the LIS for selecting recall reasons during report recall. The statistical functionality of the iLab system was utilized to investigate the proportion of reports using the selected recall reasons among the total number of reports, and to perform visual analysis of the recall data. Additionally, we employed P-Chart to establish quality targets and developed a "continuous improvement process" electronic flow form. The reasons for the recall of laboratory reports recorded in the electronic recording system were analyzed. After considering the opinions of medical laboratory personnel, a total of 12 recall reasons were identified, covering 73.05 % (1854/2538) of the recalled laboratory reports. After removing data of mass spectra lab with significant anomalies, the coverage rate increased to 82.66 % (1849/2237). The iLab system can generate six types of statistical graphs based on user needs, including statistical time, specialty labs (or divisions), test items, reviewers, reasons for report recalls, and distribution of the recall frequency of 0-24h reports. The control upper limit of therecall rate of P-Chart based on laboratory reports can provide quality targets suitable for each professional group at the current stage. Setting the five stages of continuous process improvement reasonably and rigorously can effectively achieve the goal of quality enhancement. The enhanced iLab system enhances the intelligence and sustainable improvement capability of therecall management of laboratory reports, thus improving the efficiency of the recall management process and reducing the workload of laboratory personnel.

Evaluation of Sepak Takraw Extracurricular Activities at Elementary Schools in Purworejo Regency

This study aims to analyze the results of context, input, process, and product (CIPP) evaluation of extracurricular activities at Elementary Schools in Purworejo Regency. This qualitative descriptive study uses a quantitative and qualitative approach (mixed method). The subjects of this study were principals, extracurricular coaches, and students at Elementary Schools in Purworejo, including one principal, one extracurricular coach, and several students from each Elementary School in Purworejo Regency who were willing to become samples and filled out questionnaires from researchers. The samples in this study were five school principals, five extracurricular coaches, and 50 students. Quantitative data were analyzed using percentage techniques, while qualitative data were presented through data presentation, reduction, and conclusion drawing. The results showed the evaluation of extracurricular activities in Elementary Schools in Purworejo Regency were in the category of poor. Furthermore, each aspect of the evaluation is explained; (1) Context evaluation was in good categories. The indicators of each aspect were as follows: extracurricular background had a result of 2.64 which means it was in the good category; extracurricular goals had a result of 2.39 which means it was in poor category; and extracurricular programs, with a result of 2.47 which means it was in poor category. Then, from those three indicators in context, it had a result of 2.50 meaning it was in good category. (2) Input evaluation was in poor category. The indicators of each aspect were as follows: student condition had a result of 2.47 which was in poor category, facilities had a result of 2.37 which was in poor category, the extracurricular coaches’ competence had a result of 2.53 which was in good category. Then, from those three indicators, the result was 2.46 which was in poor category. (3) The evaluation process was in poor category. The indicators of each aspect are the implementation of extracurricular activities with a result of 2.29, which was in poor category, the evaluation of the extracurricular program of 2.40 which was in poor category, too. Then, from both of indicators, the result was 2.34 which was in poor category. (4) Product evaluation was in the poor category. The indicators of each aspect were results of extracurricular activities of 2.27 which was in poor category, so from this indicator, it could be concluded that in the process resulted in 2.27 which was in poor category.

Process Evaluation Results of QUality Improvement for Effectiveness of Care for People Living With Heart Disease (QUEL):A Cluster Randomised Controlled Data-driven Quality Improvement Trial to Improve Cardiovascular Disease Care in Australian Primary Care Practices

Process Evaluation Results of QUality Improvement for Effectiveness of Care for People Living With Heart Disease (QUEL):A Cluster Randomised Controlled Data-driven Quality Improvement Trial to Improve Cardiovascular Disease Care in Australian Primary Care Practices

Implementation of the “unplugged” school-based prevention programme in Nigeria: Results of process evaluation

Process evaluation can improve the quality of program implementation and the achievement of program outcomes. This paper aims to describe the fidelity of implementation of the school-based prevention program 'Unplugged' in Nigeria, i.e., the degree to which the intervention was delivered as intended, and the satisfaction of teachers and students. The program aims to prevent tobacco, alcohol, and substance use and consists of 12 standardized units, one-hour each, delivered by class teachers. Sixteen schools implemented the program. Eleven schools, 33 classes, 27 teachers, 993 students provided process evaluation data. Eighty-two percent of classes implemented the entire program, with lower rates of activities implementation at the beginning and at the end of the program. Each unit took on average 55 minutes. More than 90% of teachers perceived high students' interest for units 1, 4, 5, 8, and 9, high interactivity for units 1, 2, 8, and 9, and declared high comfort in implementing most units. About 80% of teachers reported an improvement in knowledge, teaching skills, and relationships with students due to the program. More than 75% of students declared the program changed their way of seeing themselves, was helpful to answer questions about themselves, and improved their relationships with mates and teachers. About 95% of students reported an increase in knowledge of the consequences of substance use. Students declared Unplugged educative, informative, helpful, impacting on change, interesting and suggested the program should be spread to other schools.

Telephone-based aftercare groups for family carers of people with dementia – results of a mixed-methods process evaluation of a randomized controlled trial

BackgroundCaring for a relative with dementia can be demanding and time-consuming. It is not uncommon for them to be overburdened and overworked, which can lead to symptoms of depression or anxiety disorders in 2/3 of cases. One possibility for treating family carers who have these issues is special medical rehabilitation (rehab). However, studies have shown that while such rehab is effective, it is not sustainable.To increase the sustainability of rehab for this target group, structured telephone-based aftercare groups were implemented in the present study. A process evaluation was conducted focusing on the acceptability of the aftercare programme and its perceived benefits by the participating family carers and group moderators.MethodsThe process evaluation was embedded in a longitudinal randomized controlled trial and followed a mixed methods approach. Quantitative process data were collected using protocols and structured brief evaluations regarding the telephone-based aftercare groups. To assess the acceptability of the aftercare groups as well as their subjective evaluation by the participants, qualitative process data were collected through two longitudinal telephone-based interviews with a subsample of family carers as well as a focus group interview with the group moderators.ResultsTelephone-based aftercare groups provide acceptable and supportive experiences, and they are shown to be practicable. The content structure and the procedure of the group sessions could be easily implemented in everyday life after inpatient rehab. The topics addressed with each patient were met with a consistently positive response. Learning from the other group members and sharing a bond based on the experience of caring for a relative with dementia were evaluated as positive outcomes in the group. The universality of suffering as a central effective factor of group psychotherapy also played a decisive role in this telephone-based support group format for a shared bonding and strengthening experience in the groups and thus for their effectiveness.ConclusionTelephone-based aftercare groups for family carers of people with dementia are a useful and acceptable tool in the context of rehab aftercare. This location-independent aftercare programme could be adapted for other indications, focuses or topics in everyday care.Trial registrationGerman Clinical Trials Register: DRKS00013736, 14/05/2018.

Play Active physical activity policy intervention and implementation support in early childhood education and care: results from a pragmatic cluster randomised trial

BackgroundPolicy interventions to increase physical activity in early childhood education and care (ECEC) services are effective in increasing physical activity among young children. However, a large proportion of ECEC services do not have nor implement a physical activity policy. Play Active is an evidence-informed physical activity policy intervention with implementation support strategies to enable ECEC services to successfully implement their policy. This study examined the effectiveness, implementation, and process outcomes of Play Active.MethodsA pragmatic cluster randomised trial in 81 ECEC services in Perth, Western Australia was conducted in 2021. Services implemented their physical activity policy over a minimum of three months. The effectiveness outcomes were changes in educator practices related to daily time provided for total physical activity and energetic play. Implementation outcomes included changes in director- and educator-reported uptake of policy practices and director-reported uptake of high impact and low effort policy practices. Process evaluation outcomes included awareness, fidelity, reach, and acceptability of the intervention and implementation strategies. Analysis involved descriptive statistics and generalised linear mixed effects models.ResultsThere was a significant increase in the uptake of director-reported policy practices (p = 0.034), but no change in the uptake of the subset of high impact and low effort policy practices. Intervention group educators reported high awareness of the Play Active policy recommendations (90%). Play Active acceptability was high among educators (83%) and directors (78%). Fidelity and reach were high for most implementation support strategies (> 75%). There were no significant changes in the amount of physical activity or energetic play educators provided to children or in the proportion of educators providing the policy recommended ≥ 180 min of physical activity/day or ≥ 30 min of energetic play/day for intervention compared to wait-listed comparison services.ConclusionsPlay Active resulted in significantly higher uptake of physical activity practices. However, there was no change in the amount of physical activity provided to children, which may be explained by the relatively short policy implementation period. Importantly, Play Active had high awareness, fidelity, reach, and acceptability. Future research should investigate the effectiveness of Play Active over longer implementation periods and its scalability potential.Trial registrationAustralian New Zealand Clinical Trials Registry (reference number 12620001206910, registered 13/11/2020, https://www.anzctr.org.au/Trial/Registration/TrialReview.aspx?id=378304&isReview=true).

The Opioid Response Project: An Effective Learning Collaborative for Local Communities?

The Opioid Response Project (ORP) was designed as an intensive 2-year health promotion learning collaborative grounded in the Collective Impact Model (CIM) to prepare ten local communities to address the opioid crisis. The purpose of this evaluation was to describe the ORP implementation, provide a summary of the evaluation results, share insights, and discuss implications. Results were informed by multiple data sources, including project documents, surveys, and interviews with members of the ORP and community teams. Based on process evaluation results, 100% of community teams reported being satisfied with the ORP and recommended this experience to others. ORP participation outputs ranged from new opioid response programs, to strengthened community teams, to receipt of additional funding. Based on the outcome evaluation, the ORP was effective at increasing community knowledge and capacity, promoting collaboration, and facilitating sustainability. This initiative is an example of an effective learning collaborative to curb the opioid epidemic at the community level. Participating communities found great value in working together as part of a larger cohort and reported benefits from the peer learning and support provided by the ORP. In particular, access to technical assistance, identification of engagement strategies within and across community teams, and a focus on sustainability are key practice components to be included in learning collaboratives designed to address large-scale public health issues.

Effects of a ‘social activity program that encourages interaction’ on rural older people's psychosocial health: Mixed‐methods research

We developed a program that encourages interaction among older people living at home by combining face-to-face and online activities and examined its effects on older adults' psychosocial health. In this mixed-methods study, we recruited 11 women and 6 men (Mage=79.5 ± 6.4 years), who lived in a rural community and participated in a senior citizen club. The intervention was conducted for 13months, comprising monthly face-to-face group and social media activities. For the program process evaluation, we collected focus-group interview data on participants' perceptions of their personal lives, club membership, and community post-intervention. For the outcome evaluation, we collected six outcome measures pre- and post-intervention: loneliness, subjective health, subjective well-being, self-esteem, social support and social activity satisfaction. Finally, through the integration of the process-outcome evaluation, we inferred what effects the program had on participants' psychosocial health. In the process evaluation, we identified four themes: 'Stimulation brought about by relationships with peers,' 'Realization as to where they feel they belong,' 'Rethinking of oneself in the community,' and 'Awareness of attachment to and coexistence with the community.' In the outcome evaluation, the outcome measures were maintained without significant decline post-intervention. Through the integration of the process-outcome evaluation, we deduced three effects of the program on psychosocial health: (1) fulfilment of subjective health, (2) maintenance and assurance of moderate distance connectedness and (3) orientation toward aging in place. This study offers a promising opportunity for further development and research into community-based preventive nursing care intervention strategies to maintain the psychosocial health of homebound older people in communities with social activity groups.

A Pilot Lifestyle Behavior Intervention for Overweight or Obese Pregnant Women: Results and Process Evaluation.

This paper presents a pilot lifestyle behavior intervention effect on gestational weight gain and maternal and neonatal outcomes and intervention acceptability. Overweight or obese pregnant participants (N = 70) were randomized to the intervention or usual care group. The 20-week intervention integrated Hope theory and goal-oriented episodic future thinking (GoEFT) to prevent excessive gestational weight gain through stress and emotion management, healthy eating, and physical activity. Intervention participants completed a weekly web intervention module with 2 parts (I and II) and joined individual health coaching sessions (10 sessions). The primary outcome was gestational weight gain (GWG). Secondary outcomes included maternal and neonatal outcomes. Data were collected at 3 time points: baseline (< 17 weeks gestation, T1), 24-27 weeks gestation (T2), and 35-37 weeks gestation (T3). Intervention participants completed a semi-structured interview to evaluate the intervention. We compared GWG at T2 and T3 with T1 for intervention and usual care groups using t-tests and conducted content analysis to identify common themes for intervention acceptability. There were no significant group differences in GWG at T2 and T3. Maternal and neonatal outcomes were similar between groups. Common themes for intervention acceptability were disked web Part I intervention presented in text, the need for choosing a weekly intervention topic, raising awareness through GoEFT and self-evaluation, increased motivation through GoEFT, and usefulness of pre-written goals and goal progress evaluation. Results of process evaluation are helpful for researchers to design a lifestyle intervention to prevent excessive gestational weight gain.

SolidWorks flow simulation software potential in hydrodynamic processes analysis for cone vortex emulsion

The purpose of this work is to compare the hydrodynamic data of the real flow simulated by SolidWorks Flow Simulation in an emulsor of vortex type. The object of the study is an emulsion, in the central part of the energy separation chamber of which a zone of low pressure, the cavitation zone, is created. In this zone the dispersion phase collapses. Computer simulation of fluid dynamics of the emulsification process has been suggested to optimise the design of this type of emulsor. To check adequacy of results of modelling and real process, visualization and comparative evaluation of shape of flows at pressure of liquid at the inlet 0.4 MPa and its kinematic viscosity 10−6 m2/s. The use of SolidWorks Flow Simulation software has been found to give a fairly close-to-reality overall flow pattern. When considering the calculated flow from the position of fluid displacement and comparing it with experimental data, a good match is seen in the shape of near-axis flows. Three vortex zones are clearly visible in the model. In the real flow there are similar vortex zones which, although not clearly visible, are visualised by photography. With the software, the overall flow pattern is fairly close to reality. However, it is not possible to conclude that the velocities of the calculated and real flows coincide. By considering the various design changes in the simulation and evaluating their effect on the hydro and thermodynamics of the process, some regularities can be identified and used in the design of new designs, i.e., the results of computer simulation can be a good guide in the design of new devices.

SUPPORTING NURSING HOME MANAGERS TO ACT ON PERFORMANCE FEEDBACK DATA: A PROVINCEWIDE IMPLEMENTATION

Abstract INFORM (Improving Nursing home care through Feedback on perfoRMance data) is a tested research intervention targeting care managers that demonstrated positive two year follow up results and has subsequently been shaped into an operationally acceptable “implementation package”. This package or innovation is being scaled up in one Canadian province’s total Long-Term-Care (LTC) home population with in depth process evaluation during the first cohort of LTC homes. This evaluation will, among other things, assess sector needs for adaptation (vs fidelity). At its core INFORM is designed to address managers’ learning needs with respect to using data to make positive change in a continuous learning loop. We will discuss the transformation of a research intervention to a sector innovation and report on interim process evaluation results.

Implementation of the Afya conditional cash transfer intervention to retain women in the continuum of care: a mixed-methods process evaluation

ObjectivesWe report the results of a mixed-methods process evaluation that aimed to provide insight on the Afya conditional cash transfer (CCT) intervention fidelity and acceptability.Intervention, setting and participantsThe Afya CCT...

EVALUATION OF SPORTS AND HEALTH PHYSICAL EDUCATION PROGRAM IN SMA N 2 NGAWI USING THE CIPP EVALUATION MODEL (CONTEXT, INPUT, PROCESS, PRODUCT).

The purpose of the study is to evaluate the physical health and sport education at SMA N 2 Ngawi using a context, input, process, product (CIPP) evaluation model approach. The research method used in this research is program evaluation. The approach taken in this program evaluation research uses the CIPP evaluation model (Context, Input, Process, Product). Sources of research data are principals, teachers, and students. The data collection technique used is an assessment questionnaire instrument / score scale questionnaire. The data obtained were then analyzed using quantitative descriptive data analysis techniques. This study found that the results of the context evaluation were 83.69% in the good category, the results of the input evaluation were 84.40% in the good category, the process evaluation results were 86,67% in the good category, and the product evaluation results were 89.60 in the good category. Based on the results of the CIPP evaluation research, it can be concluded that the physical health and sport education program at SMA N 2 Ngawi is in the good category with an achievement value of 86.09%.Keywords: Physical Education, Sports, Health, CIPP Evaluation, School.

Mixed methods study design, pre-analysis plan, process evaluation and baseline results of trailbridges in rural Rwanda

We present a study design, pre-analysis plan, process evaluation and baseline results designed to establish the impact of trailbridges on health, education, agricultural and economic outcomes of households in rural Rwanda. This intervention and study is being implemented in communities that face barriers to socioeconomic development through periodic isolation caused by flooding. We describe a mixed methods approach to measure the impacts of these trailbridges on outcomes at the village level. The study is anchored on a stepped-wedge randomized controlled trial (RCT) implemented in 147 sites: 97 phased-in intervention sites and 50 long-term control sites. These sites are being monitored in four annual waves comprising of a baseline period and three subsequent follow-up waves. We will supplement the RCT with three sub-studies. First, we are investigating the role of weather events and streamflow variability on temporal and spatial bridge use patterns among intervention sites. We will then find the relationship between the weather events, streamflow and bridge use from motion-activated cameras installed in intervention sites. Secondly, we are following 42 markets serving study sites to investigate the impact of the trailbridges on the market prices of key goods including crops, livestock and agricultural inputs. Lastly, we are following 30 villages that are more distant from the river crossings to determine the spatial extent of the trailbridge impacts. Our study will advance knowledge by generating new data on the impact of rural infrastructure and providing the opportunity to explore a range of outcomes for future evaluation of infrastructure in low- and middle-income countries. We will enable an outcomes-based funding model that ties implementer payments to demonstrated positive impacts of these trailbridges. Furthermore, we will identify cost-effective, easily assessed measures that are highly correlated to the economic and health benefits of the intervention. These measures may then be used by a portfolio of interventions across multiple geographies without always requiring complex trials.

Telephone and Web-Based Delivery of Healthy Eating and Active Living Interventions for Parents of Children Aged 2 to 6 Years: Mixed Methods Process Evaluation of the Time for Healthy Habits Translation Trial.

BackgroundFew translational trials have provided detailed reports of process evaluation results.ObjectiveThis study reported on findings from a mixed methods process evaluation of a large translational trial comparing 2 remotely delivered healthy eating and active living interventions with an active control, targeting parents of young children.MethodsMixed methods process evaluation data were collected as part of a 3-arm, partially randomized preference trial targeting parents of children aged 2 to 6 years from New South Wales, Australia. Recruitment strategies were assessed through the participant baseline questionnaire and a questionnaire completed by the health promotion staff involved in recruitment. Data on participants’ intervention preferences were collected at baseline and after the intervention. Intervention acceptability and demographic data were collected via a postintervention questionnaire (approximately 3 months after baseline), which was supplemented by qualitative participant interviews. Implementation data on intervention fidelity and withdrawal were also recorded. Differences in intervention acceptability, fidelity, and withdrawal rates between telephone and web-based interventions and between randomized and nonrandomized participants were analyzed. The significance level was set at P<.05 for all tests. The interview content was analyzed, key themes were drawn from participant responses, and findings were described narratively.ResultsData were collected from 458 participants in the baseline survey and 144 (31.4%) participants in the 3-month postintervention survey. A total of 30 participants completed the qualitative interviews. A total of 6 health promotion staff members participated in the survey on recruitment strategies. Most participants were recruited from Early Childhood Education and Care services. There was a broad reach of the study; however, better take-up rates were observed in regional and rural areas compared with metropolitan areas. Parents with a university education were overrepresented. Most participants preferred the web-based medium of delivery at baseline. There was high acceptability of the web-based and telephone interventions. Participants found the healthy eating content to be the most useful component of the modules (web-based) and calls (telephone). They regarded text (web-based) or verbal (telephone) information as the most useful component. A high proportion of participants completed the telephone intervention compared with the web-based intervention; however, more participants actively withdrew from the telephone intervention.ConclusionsThis is one of the first studies to comprehensively report on process evaluation data from a translation trial, which demonstrated high acceptability of all interventions but a strong participant preference for the web-based intervention. This detailed process evaluation is critical to inform further implementation and be considered alongside the effectiveness outcomes.

Conducting a Process Evaluation in Nonprofit and Governmental Programs

The purpose of a program evaluation is to assess a program’s performance. This article explains how to (1) identify which type of failure nonprofit organizations may be facing, (2) choose the right evaluation tool in order to determine the specific problem, (3) interpret process evaluation results, and (4) use the evaluation findings for continuous program improvement. Written by Marlen Barajas Espinosa, Micayla Richardson, Chelsea DeMasters, Jennifer A. Jones, and Kimberly Wiley, and published by the UF/IFAS Department of Family, Youth and Community Sciences, May 2022.